DOCUMENT RESOHE 

TH OOa 409 

Littl€f ieldy John H. 

An Investigation of Instructor Accuracy in Predicting 
Course-Instructor Eatings by Students. 
3 Apr 75 

17p«; Paper presented at the Annual Meeting of the 
American Educational Research Association 
(Washington^ D. March 30- April 3, 1975) • Document 

not available in hard copy due to marginal legibility 
of original document 

MF-$0.76 HC Not Available from EDES^.PLOS POSTAGE 
Class Size; College Instruction; College Students; 
♦College Teachers; ^Effective Teaching; ^Participant 
Satisfaction; ^Prediction; Predictor Variables; 
Student Teacher Relationship; Teacher Attitudes; 
Teacher Characteristics; *Teacher Evaluation; Teacher 
Improvement; Teacher Rating; Teaching Methods 



This study investigates the relationship of (1) 
previous course-instructor rating feedback, (2) class size, and (3) 
various instructor personal characteristics, with the tendency of 
college instructors to make large errors in predicting 
course-instructor ratings by their students. Significant over- and 
under-predictors were identified for each of four principal 
components of student response. Previous student rating feedback was 
not related to making significant errors in prediction. Instructor 
content area was related to predictive errors regarding 
instructor-student interactions. Instructor age and teaching 
experience were related to significant over-prediction regarding 
instructor competence and classroom organization. (Author) 



ED 104 951 

AUTHOR 
TITLE 

PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



ABSTRACT 



ERIC 



o 



AN INVESTIGATION OF INSTRUCTOR ACCURACY IN PREDICTING 
COURSE-INSTRUCTOR RATINGS BY STUDENTS 



John H. Littlefield, Ph.D. 
Learning Evaluator 
Office of the Assistant Dean for Education 
Texas Tech University 
Health Sciences Centers 
Lubbock, Texas 79409 




© 
© 



US OEPARTMENTOF HEALTH, 
EOUCATION4WELFARE 
NATIONAL INSTITUTE OF 
EOUCATION 

THIS DOCUMENT HAS OCfcN «EP«0 

ouceo EXACTLY AS ftcceivEO ^-wom 

THE PERSON Oft ORGANIZATION ORl&lN 
AT|NG»T PCINT'.O^ ViEWOW OPIMONS 
STAtCO 00 NOT NlCESSAPILY (iCpfif 
SENT Of" f l<"iAL NATIONAL tNSTITUTC OP 
EOUfATtON POSntON OP POL'<"V 



Paper Presented at the Annual Meeting of the 
American Educational Research Association 
Washington, D»C» 
April 3, 1975 



ERLC 



AN INVESTIGATION OF INSTRUCTOR ACCURACY IN PREDICTING 
COURSE-INSTRUCTOR RATINGS BY STUDENTS 



ABSTRACT 

This study Investigates the relationship of (a) previous course- 
instructor rating feedback, (b) class size, and (c) various instructor 
personal characteristics, with the tendenc}' of college instructors to 
make large errors in predicting course-instructor ratings by their students • 
Significant over- and under-predictors were identified for each of four 
principal components of student response. Previous student rating feed- 
back was not related to making significant errors in prediction. Instructor 
content area was related to predictive errors regarding instructor-student 
interactions. Instructor age and teaching experience were related to 
significant over-prediction regarding instructor competence and classroom 
organization. 

BACKGROUND 

The collection of course-instructor ratings (CIR) by students is a 
standard practice in many U. S. colleges and universities. One use of 
this information is to provide formal student feedback to instructors. 
Eble (1970) notes that CIR results seen only by the instructors provide 
a widely accepted means of improving teaching. In discussing the effect 
of student ratings upon teaching skills, Eble states: 

The skillful teacher, like the skillful actor, may not need the 
feedback such questionnaires can provide. He may already possess 
a keen and constant sense of the relationship between what he is 
doing and the way students respond. In addition, the teacher has 
other measures — tests, papers, oral reports — which give him infor- 
mation about the way a course is going. But teachers must acquire 
teaching skill, and even skilled teachers fall into comfortable 
routines.. .(1970, p. 34) 

In short, Eble suggests that the CIR procedure provides continuing student 
feedback which can aid an instructor in developing and maintaining his 
teaching skills by improving the accuracy of his perception of how students 
respond to his teaching activities. 

Recently, several researchers have investigated the feedback effects 
of course-instructor ratings upon college instructors. Two types of 
criterion measures have been used as dependent variables: (a) changes 
between midsemester and end of semester student ratings (Miller, 1971; 
Braunstein, Klein, and Pachla, 1973; Emmer, McBurnette, & Davis 1974); 
(b) differences in end of semester ratings between instructors who have 
received midsemester CIR feedback and a control group which did not re- 
ceive feedback (Centra 1973a). These criterion measures do not directly 
assess the effects of student feedback upon the accuracy of instructor 
perceptions of their students* viewpoints toward the course. 
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IVo previous researchers have considered the relationship between 
instructor self descriptions '^nd ratings by their students, Webb and 
Nolan (1955) report a correlation of .62 between student ratings of 
instructor traits and instructor self ratings. Centra (1973b) found a 
median correlation of .21 between instructor self ratings and student 
ratings across 21^ CIR items. Three major conclusions can be drawn from 
Centra's study: 

1. Instructors generally rated themselves more favorably than 
their students did. 

2. The greatest instructor-student disagreement centered on CIR 
items dealing with teacher-student interactions, 

3. There were no significant effects for instructor sex or teaching 
experience on accuracy of prediction. Natural science instructors 
tended to underestimate the course workload, while education 

atid applied science instructors tended to overestimate the 
reported workload. 

Social perception has been defined as the ability to interpret the 
viewpoint of others (Tagiuri, 1969), It is operationally defined as the 
discrepancy between the responses of a subject and a judge's predictions 
of those responses. Within the context of coucse-instructor ratings, 
itistructors could predict the mean response of their students on each 
item of a student rating instrument. If tha discrepancy between instructor 
predictions and actual student ratings is small, the instructor's social 
perception is considered to be accurate. (Note the difference between 
instructor self ratings used by Webb and Nolan (1955) and Centra (1973b) 
and instructor predictions of their student ratings utilized to measure 
accuracy of social perception.) 

Distance scores (D = (X-Y)^; where X and Y are judge's predictions 

iri 

and subject's responses respectively) have traditionally been used as an 
operational measure of social perception (Dymond, 1949, Gage, 1953; Gage, 
Rurkel and Chattergee, 1963). Cronbach (1958) provided several methodo- 
logical criticisms of the distance score as a social perception measure. 
Two of these criticisms were: 

1. The squaring procedure ''throws out" information regarding the 
direction of prediction errors, 

2. The distance score technique sums differences across hetero- 
genous items. 

Very few recent researchers have utilized distance scores as a measure of 
social perception (for exceptions see Daniellian, 1967; and Cline & Richards, 
1962). No one has offered a methodological innovation for meeting Cronbach 's 
criticisms of distance scores. 

To summarize, previous researchers have not investigated the effects 
of CIR feedback or other instructor characteristics upon the accuracy of 
instructor social perception regarding their students' viewpoints. One 
factor which has undoubtedly limited recent research is the methodologica] 
complexity of using distance scores as an operational measure of social 
perception. 
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METHODOLOGY 

Subjects for iMs study were all instructors in the University of 
Texas at Austin Colleger of Social and Behavioral Sciences, Hvim^tnities , 
Natural Sciences, and the School of Communication who participated in the 
Course-Instructor Survey during the 1973 Fall Semester, The sample was 
limited to instructors teaching in "traditional'* classroom settings, 
namely one teacher and 10 to 49 students. The sample instructors esti- 
mated tlieir mean student response for each of 24 items frora the Course- 
Instructor Survey: General Questionnaire prior to receiving the results of 
their student rating^. Appendix B. contains the data collection instrument. 

Data analysis procedures consisted of four separate steps: 

1. Principal Components Analysis was performed on student mean 
item responses for all yf the sample instructors. Principal 
components with eigen roots greater than one were extracted 
and rotated to a Varimax criterion. Principal component 
scores were computed for each sample instructor. 

2. Instructor Predictions were computed by applying the principal 
components weights frora step 1 to the individual instructor 
predictions of their students* mean item responses. A pre- 
dicted score analogous to th^ principal. component scores in 
step 1 was computed for each instructor. 

3. Instructor Predictive Accuracy was measured by subtracting 
the actual principal component score (based upon student 
ratings) from the instructors* prediction. This operation 
can be represented mathematically as follows: 

where PA^ . represents the predictive accuracy score of instructor 
"i*' on principal component *'j*', IP is the instructor*s prediction 
for component j, and PC is the instructor *s principal component 
score based upon the responses of his students. Thus PA is a 
measure of insti*uctor predictive accuracy within each independent 
dimension of the CIR instrument. A significant error in predictive 
accuracjj is defined as PA^^>FA + (overprediction) or 
PA£j< PA - Op^- (underprediction) . 

4. Chi square Analysis was performed on the characteristics of 
instructors who were categorized as over- or under-predictors 
on '^jch principal component. 

The analysis procedures in steps 1 and 2 were designed to counter 
Cronbach's (1958) criticisms of the distance score technique as a measure 
of social perception. The choice of PA ± o as the criterion for defining 
significant predictive inaccuracy was based upon its use by Centra (1973b) 
Chi Square was chosen as the final analytical procedure because the bipolar 
nature of social perception (i.e., significant over- or under-predict ion) 
precludes the use of parametric statistics. 
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The final subject sample consisted of 318 instructors (79% response 
rate). Data was collected for seven instructor background characteristics: 
sex, age, faculty rank, college, teaching experience, class size, and 
previous CIR experience. Appendix D provides a detailed breakdown of 
instructor background characteristics. 

A principal components analysis and varimax rotation (Veldman, 1967) 
was performed on the mean student responses for 22 items from the Course- 
Instructor Survey: General Questionnaire (Appendix A). Items 27 and 29 
were omitted due to the large proportion of instructors who failed to 
predict cheir student ratings. Four principal components which accounted 
for 73.7% of the original variance were extracted. Analysis of the CIR 
items which loaded heavily on each component resulted in the following 
names : 



(a) 


Component 


I (eigen root « 11.13): 


Student-Instructor Interactions 


(b) 


Component 


II (eigen root = 2.52): 


Student Expectations 


(c) 


Component 


III (eigen root = 1.2A): 


Instructor Competence 


(d) 


Component 


IV (eigen root = 1.31): 


Classroom Organization 


Appendix C provides 


the General Questionnair 


3 items which loaded .40 or 



higher on each principal component. 

The summary results of the Chi Square Analysis are outlined in Table 
I below: 



Table T 
Sutunary of the Chi Square Teste 







Ovcr- 


Predictors 






-J 

Under-Predlccors 


Conip I 


Corp II 


Comp III 


Comp IV 




Cor.p T 


Comp II Cotrp III 


Cofljp IV 


CU33 Size (<if-2) 


ns 


p < . 001 


ns 


ns 




np 


n*; 


ns 


Instructor Sex (df*l) 


ns 


p < .01 


ns 


ns 




ns 


ns 


ns 


Instructor Tenure (df-1) 


ns 


p - .05 


p < .05 


p < .01 




ns 


ns 


p < .01 


Instructor Age (d£*3) 


ns 


P < 05 


p < .001 


p < .01 




ns 


ns 


P < .05 


Instructor Teaching 


















Experience (df-2) 


no 


ns 


p < .01 


p < .01 




ns 


ns 


p < .01 


Instructor Previous 


















CIR Feedback (d£-2) 


ns 


nfl 


ns 


p < .01 




na 


na 


p < .05 


Instructor Content 


















Area (df-3) 


p < .01 


p< .0001 


p < .01 


ns 1 


p < .01 


ns 


p < .01 



Note that no Chi Square tests are reported for the under-predictors on 
Component II (Student Expectations). The distribution of instructor 
predictive accuracy scores for Student Expectations was skewed to an 
extent that no instructors were more than one standard deviation below 
the mean. 
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Summary interpretations of the significant Chi Square tests are 
presented in Table 2 below. A more detailed presentation of expected 
and observed frequencies is available upon request. 



Table 2 

Significant Chi Square Tests for each Principal ComponehL 



1. Comnonent I: Instructor-Student Interactions 

a. Over-predictors: instructors in the College of Natural Sciences 

b. Under-predictors : instructors in Humanities and in the School 

of Communication 

2. Component II: Student Expectations 

a. Over-predictors: instructors in classes with 10-20 students 

female instructors 
nontenured instructors 
instructors who are 20-25 years old 
instructors in the College of Humanities 

3. Component III: Instructor Competence 

a. Over-predictors: nontenured instructors 

instructors over age 30 
instructors with more than 6 

experience 
instructors in the School of 

4. Component IV: Classroom Organization 

a. Over-predictors: tenured instructors 

instructors over age 30 
instructors with more than 6 

experience 
instructors with more than 6 

rated by students 

b. Under-predictors: non ♦'enured instructors 

instructors under 30 years old 
instructors with less than 2 years teaching 
experience 

instructors with less than 6 courses previously 
rated by students 
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years teaching 
Conmiunication 



years teaching 
courses previously 
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DISCUSSION 

The. overprod iction on Comi)oncMU I by iiistrurtors in iho (*(>llei;o 
Natural Science complements the findings of Contra (1973b) rej^ord in^'. a 
tendency for Natural Scientists to underestimate the course worKlD.ui. 
These results suggest a stereotype of the NaturaJ Scientist as <\\\ ititro- 
verted individual who does not actively interact with students (Rot% I9')7). 
The significant underpredictions on Component I by instructors in Humanities 
and the School of Communication emphasizes the possibility that instructor 
content area may be a useful predictor of directional errors in predicting 
the viewpoints of students. However, at this time both of the above inter- 
pretations must be accepted as tentative and deserving further study. 

The interpretation of the results for Component II (Student Expecta- 
tions) is complicated by cho fact that a large proportion of the Humanities 
classes taught by young nontenured instructors at the University of Texas 
are introductory foreign language courses. These courses are traditionally 
not a favorite among students, therefore one might anticipate low student 
ratings in terms of their expectations for the courses and consequently a 
tendency for instructors to over-predict. 

The results of identifying over-predictors on Components III and IV 
are subject to a very interesting interpretation. Both of these components 
are related to "teaching expertise." In both cases it appears that experi- 
enced teacher^, become over confident regarding student perceptions of their 
teaching skills. In contrast, inexperienced instructors tended to signifi- 
cantly under-predict their students' responses on Component IV. 

Finally, it should be noted that across all four principal components, 
instructors with no previous CIR feedback experience did not make more 
significant errors of prediction than did instructors with CIR feedback 
experience. 

CONCLUSIONS 

Two primary conclusions may be drawn from this study. First, a 
technique for measuring social perception has been demonstrated. This pro- 
cedure seens to satisfy the methodological criticisms of distance scores 
as a measure of social perception (Cronbach, 1958). 

Second, the results indicate that previous CIR feedback does not 
reduce the probability of making errors in predicting student responses. 
On the ocher hand, instructor content area was related to significant 
prediction errors regarding Instructor-Student Interactions while teach- 
ing experience was directly related to making significant over-predictions 
regarding "teaching expertise"(Components III and IV). The survey nat:ure 
of this study requires that results be accepted somewhat tentatively; how- 
ever, if replicated they offer some definite guidelines to educators in- 
terested in developing teaching skills among college faculty members with 
diverse previous teaching experience and content specialities (Popham, 1974). 
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Appendix A 

THE UNIVERSITY OF TEXAS AT AUSTIN-^URSE-INSTRUCTOR SURVEY: GENERAL OUESTIQMNatpp 



DIRECTIONS: PLEASE MARK YOUR RESPONSES TO EACH ITEM ON THE SEPARATE ANSWER SHEET. 



1. My classification is: 

A = Graduate B = Senior C = Junjor D = Sophomore E = Freshman 

2. My sex is: 

A « Male B = Female 

3. My final grade in this course will probably be: 

A=A B=B C=C D=D E=F 

4. My overall grade-point average at UT Austin is: 

A = 3.50 - 4.00 B = 3.00 - 3.49 C = 2.50 . 2.99 D = 2.00 . 2.49 E = Less than 2.00 
5&6. The college or school in which I am enrolled is: (Mark only one response) 

5 A = Arts & Sciences 5B = Business Admin. 5C = EducaUon 5D = Engineering 5E = Fine Arts 
6A - Riarmacy 6B = Architecture 6C = Conrmiunication 6D = Nursing 6E = Other 

7. I took this course to satisfy: 



A = Major or minor field requirements 
B = Other specific degree requirements 
C = Elective credits required for degree 



p - Non^cgrcc requirements (e.g., teacher certification) 
E = No requirement! at all 



Items 8 - 32 all use the same response scale in which: 

A = Definitely Yes 
B = Yes 

C = Uncertain or neutral 
D - No 

E = Definitely No 
Do not mark responses to items which are not relevant to this course. 
Please explain or elaborate on your responses in the COMMENTS section of the answer sheet. 



8. 


The 


9. 


The 


10. 


The 


II. 


The 


12. 


The 


13. 


The 


14. 


The 


15. 


The 


16. 


The 


17. 


Tlie 


18. 


The 


19. 


The 


20. 


The 


21. 


The 


22. 


The 




The 
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24. The tests were usually gr?dcd and returned promptly. 

25. I was satisfied ^th the way the performance of students -^as evaluated in thi$*co«nc. 

26. The textbooks were adequate for this course. 

27. The reference books and materials in the library were adequate for this course. 

28. I feel that I profited from the out*of*cUss asdgnmente. 

29. I feel that I profited from the laboratory (or discussion section) for this course. 

30. Before the semester began, I thou^t I would enjoy this course. 

31. Before the semester began, I thou^t this course would be of value to me. 

32. At this point in time, I feel that this coune will be (or has already been) of value to me. 



For items 33 • 40, choose the appropriate 
response from thoK given for each item. 



33. The amount of outside preparation required for this course wis: 

A = Excessive D « Low 

B = High E « Insignificant 

C = About right 

34. For each hour of class, the average amount of time I spent on this course outside of class was about: 

A = 2 hours or more D « H hour 

B = IH hours E * Leu than H hour 

C = 1 hour 

35. Compared with the effort I usually put into a course, my effort in this course wu: 

A = Well above avenge D « Below average 

B = Above avenge E « Well below avenge 

C = Average 

36. I met with the instmctor outside of class to discuss the coune: 

A = Many times D « Never, because I couldn't find him 

B « A few times E « Never, because I never tried 

C « Only .ice or twice 

37. I was absent from class: 

A = Never D « 5 to 9 times 

B = Once or twice Z « lO times or more 

C = 3 or 4 times 

38. Compared with all the instructors ! have had, both in high sAool ind In college, this i^Mruclor was: 

A = One of the best D « Below average 

B = Above avenge E « Far below average 

C = Average 

39. Compared with all the courses I have had, both in high school and in college this coune was: 

A = One of the best D » Below miage 

B = Above average E « Far below average 

C = Average 

40. Compared with what I expected to get from this course, I feel I got: 

A = Far more than I expected D « Less than I expected 

B ^ More than I expected E « Far lets than I expected 

C ' What 1 expected 



PLEASE NOTE THESE SPECIAL INSTRUCTIONS FOR THE COMMENTS SECTION OF THE ANSWER SIfflET. 
Many instructors have indicated that written comments help them undentand better the responses given to the 
multiple<hoice items, and that the written commcnU frequently contain very helpful and conitructive recommendations, 
Please take the time and effort to: 

a. Explain or elabonte on vour responses to the previous 40 items. 

b. Suggest ways in which the instructor can improve his teaching. 

c. Suggest ways in which the course can be improved. 
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Appendix B 



Intcruccor S«lt lUCln^ Form 
^Course ;^ ^Course Un^u« No: 



II. 



llcJkjxLMimJ jn/j)_rjp>iclun. Plea*, fill la Che blank or put q check by the appropriate 
respoiue for e^ch lt»'m helow. All Information will be k^pt strictly conf Idf nt lal . 

1. Se*: (1) r^aale (2) ^Kale 

2. Faculty Rank: (I) ^Teaching Assistant (5) ^Lecturer 

<2) ^Assistant Instructor (6) ^Associate *or 

O) instructor (7) Professor 

W Assistant Professor 

3- A««s (1) 20-25 (2) 26-30 (3) ^31-35 (4) 36-40 (5) ^41-50 

(6) 51-60 (7) ^Over 60 

4. Total Years of college-level teaching experience: 

5. In your previous teaching experience^ how taany tlaes (total nurab^r of courses) have 
you received formal student ratings such as the Course-Instructor Survey Kesults? 
(1> No previous experience (4) 3-6 courses (?) 9-10 courses 

(2) 0 courses (5) 5-6 courses (8) 11-15 courses 

courses (6) 7-8 courses (9) ^pora than 15 courses 

6. Of the cour^^es you have previously taught, boch at I'.T. Austin and cUcwhere. In 
approximately what proportion did you rece;>'e fornal student ratings? 

(1> ^No previous experience (3) ^about 25? (5) ^aUout 7SX 

W ^Wone (4) ^,bout 50Z (6) ^lOOX 

Instructor S.elf Pati^s^ We are attempting to deteralne how accurately an Instructor 
can ju.lg% the opinion* of his students about his course and teaching techniques prior 
to receiving tormal student feedoacK. foe this study, student opUlon has been coacapt. 
ualUed ae a r.uober line wnlch extends front -2.0 to +2.0. In terras oC the Course- 
Iruitructor Survey questionnaire tliesc nuabers are assigned as follows: 

0*fi"Ac«ly Uocert.lo Definitely 

^ No or Neutral yes Yes 



1 — — I 



•2-0 -1-0 --5 0.0 +.5 +1.0 +1.5 ^2.0 

If a class as a whole perceives an Instructor as being very strong on a particular trait 
(e.g., paced the course well), the location of thetr opinions would be near the 4' 0 end 
of the scale (e.g., 1.9). If the class nemhers "generally agreed" tliat the course W4» 
^""^.t location of opinion might br l.l wnlle If the class was sonewhat uncertain 

whether the Instructor paced the course appropriately, the consensus of opinion »wht be 
.3. Finally, if oany students felt that the course was oot picea veil, the location of 
student oplolon on the scale mignt be a -1.2. 

The Iteas below were drawn from the Tourse-Inscruc tor Survey questionnaire used In 
your depact»«nt for :he Fall Semester 1973. For each itea estimate the opinion of your' 
Fall 1973 students encoUed in the course Inoicated at the top of chls page, using the 
-2.0 0 |2.0 scale descr.bed above. In the blank at the left of each Itee, write the 
Qu»«rlcal value of the poUt on the scale which you feel corresponds to t;»e averaj^e 
oplolon of your students. A saaple ite« has oeen aurked to provide an example. 

(example Item) The Instructor presented rhe material coherently. 
_ 2. The Inntructoc seemed to be sensitive to the feelings and aeedr of students . 
_ 3. The Instructor seemed well-prepared for lecture or discussion. 
_ ^. The Instructor showed confidence before the class. 

_5. The instructor kept his lectures and cUss discussions focused on the nubject of the 
course. 

_ 6. The Instructor usually seemed to be aware of whether cha class was Collowlna his 
presentation witn understanding. * 

7. The Instructor used clear, relevant exanples. 

_d.. The instructor's speech and lecture style contributed to his teaching cf foctlveoese. 

^ 9. The Instructor m^de »« feel free to ask questions, disagree, and express my ideas. 

JO. The inetructor was Intellectually stimulating and thought-provoking. 
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11. Th« In^cruccor shoved g^nuln. tncirtsc In ccachtng ch« course. 

12. Th« Interuccor was g«n«rjily •ccssglbi. co icudenci oucitd* oC cU«s. 

13. Th« Inscruccor conuncnccd Informac Iv^ly on C«9Cs and aaaignnenca. 

14. Thip Ccscs wer« usutiUy »;rHd«d and rccurnej prorpdy. 

belori- the *^t»K^ttr l»^«;m. i ihoughl I would «nJoy (hU cuun**. 
.16. Hctor* Che ■ieoi«:iCei b«gan, I thought chit couri* wot.ld b« of valua co ov«. 

Iilu!!\'o^^?' ^" ^ ^* bean) 'or 

16. Tha Inscruccor paced chc course well. 

19. I was saclsfl^d with che way che perforrsance of scuden'^ . ev.lu4Ced lo chis course. 

20. The ccxcbooks were adequace for chis course. 

21. The reference books and oucerials in che library were adequate for this course. 

22. I feel that 1 proi Itkd fro« the ouc-of-cless assi|truMncs. 

23. I feel that I profited fro. the laboratory (or discussion section) for this course. 
lll. Su^rr lutio^s by the Students. For the twp lte«a belov utilize th. following scale. 

Fer belov Below _ 

Average Average Overate f ^* '^'^ 

I , Average Average Best 

^ ' ^ ''''''''' i I / 

-^•^ -^-^ -5 0.0 +.5 +1.0 +i.5 +2.0 

coc'rirwai;!'' ' "^-^'^ "i^M., Chis 

J^I^u'Jor'w^^^ io.cructore I have had, boC^. in high school end m college, this 

-Initructor Evaluation o f th^ Course-Io,cructor Survey Svstea 

Ir.clllT' ""'-"^ — - • for you to i-prove 

A. Very valuable 

>. Useful for iaprovlng certain aspects of teaching 

C. Of margtnal value 

D. fairly ueelesa 

2. Mease explaia briefly why you participate in the Course-Instructor Survey. 
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Appendix C 

Independent Dimensions of the 
Course-Instructor Survey' General Questionnaire 



Component I - Student-Instructor Interactions (eigenroot=ll. 13) 


Item Description Principal 

Component Loading 


1. 


Instructor made me feel free to ask 
questions, disagree, and express my ideas. 


.9082 


2. 


The instructor seemed to be sensitive to the 
feelings and needs . f the students. 


.8462 


3- 


The instructor usually seemed to be aware of 
whether the class was following his present a— 
tion with understanding. 


,6965 


4. 


The in'^xtructor commented informatively on 
tests and assignments. 


.6965 


5. 


The instructor was generally accessible to 
students outside of class. 


.6354 


6. 


Tho instructor's speech and lecture style 
contributed to his teaching effectiveness. 


.6270 


7. 


I was satisfied with the way the performance 
of students was evaluated in this course. 


.6155 


8. 


The instructor used clear, relevant examples. 


.6090 


9. 


The insCructor showed genuine interest in 
t each ing t he cour se . 


.5900 


10. 


Compared with all instructors I have had, both 
in high school and in college, this instructor 
was . . . 


.5805 


11. 


The instructor was intellectually stimulating 
and thought-provoking. 


.5212 


11. 


At this point in time, I feel that this course 
will be (or has already been) of value to me. 


.5140 



ERIC 
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Appendix c(continued) 


Component I - Student^Instructor Interactions (eigenroot=ll . 13) 


Item Description Principal 

Component Loading 


13. 


The instructor paced the course well. .4995 


14. 


I feel that I profited from the out-of- 

class assignments. .4250 


15. 


Compared with all the courses I have had, 

both in high school and in college, this 

course was. . . .4122 


Component II - Student Expectations (eigenroot=2 . 52) 


1. 


Before the semester began, I thought this 

course would be of value to me, ^9259 


2. 


Before the semester began, I thought I would 

enjoy this course. .8947 


3. 


At this point in time, I feel that this course 

will be (or has already been) of value to me. .4703 


Component III - Instructor Competence (eigenroot=l . 24) 


1. 


The instructor showed confidence before the 

class. .7817 


2. 


Compared with all the courses I have had, 

both in high school and in college, this course ' 

was. . . .6971 


3. 


Compared with all instructors I have had, both 
in high school and in college, this instructor 
was. . . .6902 


4. 


The instructor seemed well-prepared for 

lecture or discussion. ,6697 


5. 


The instructor was intellectually stimulating 

and thought-provoking. ,6345 
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Appendix C (continued) 





Component III - Instructor Competence (eigenroot 


=1.24) 


Principal 

Item Description Component Loading 


6. 


The instructor's speech and lecture style 
contributed to his teaching effectiveness. 


.6238 


7. 


The textbooks were adequate for this course. 


.5921 


Q 


The instructor used clear, relevant examples. 




9. 


I feel that I profited from the out^-of-class 
assignments . 


.5689 


10. 


At this point in time,* I feel that this course 
will be (already has been) of value to me. 


.5475 


11. 


The instructor showed genuine interest in 
teaching the course. 


.5395 


12. 


The instructor usually seemed to be aware 
of whether the class was following his 
presentation with understanding. 


.4326 


Component IV Classroom Organization (eigenroot=l ,31) 


1. 


The tests were usuw ^ly graded and 
returned promptly. 


.7644 


2. 


The instructor kept his lectures and 
class discussions focused on the subject 
of the course. 


.7352 


3. 


The Instructor seemed well-prepared for 
lecture or discussion. 


,5839 


4. 


The instructor commented informatively 
on tests and assignments. 


.5360 


5, 


The instructor paced the course well. 


.4771 


6. 


I was satisfied with the way the performance 
of students was evaluated in this course. 


3986 
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Appendix D 

Background Characteristics of the Subject Sample 

(N = 318) 



Sex 


a, Male 

b. Feraale 


63% 
32% 


Faculty 
Rank 


'a. Teaching Assts, 

b. Instructors 

c. Asst. Professor 

d. lenureo rroressor 


40% 
15% 
30% 
14% 


Age 


a. 20 - 25 years 

b. 26-30 years 

c. 31 - 35 years 

d. over 35 years 


18% 
35% 

LI h 

21% 


Teaching 
Experience 


a. Less than 2 years 

b. 2 - 6 years 

c. More than 6 years 


28% 
53% 
19% 


Previous 
CIR 

Participation 


a. 0 courses previously 
rated 

b. 1-6 courses previously 
rated 

c. More than 6 courses 
previously rated 


11% 
40% 

33% 


C. liege 


a. Humanities 

b. Communication 

c. Social & Behavioral 
Sciences 

d. Natural Sciences 


44% 
10% 
24% 

22% 


Class 
Size 


a. 10-20 students 

b. 21-30 students 

c. 31 - 40 students 

d. 41 - 49 students 


40% 
30% 
19% 
11% 



★Percentages within each cell may not sum to 100% due 
to rounding errors. 
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